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Abstract 

Robust optimization is a young and emerging field of research having received 
a considerable increase of interest over the last decade. In this paper, we argue 
that the the algorithm engineering methodology fits very well to the field of robust 
optimization and yields a rewarding new perspective on both the current state of 
research and open research directions. 

To this end we go through the algorithm engineering cycle of design and analysis 
of concepts, development and implementation of algorithms, and theoretical and 
experimental evaluation. We show that many ideas of algorithm engineering have 
already been applied in publications on robust optimization. Most work on robust 
optimization is devoted to analysis of the concepts and the development of algo¬ 
rithms, some papers deal with the evaluation of a particular concept in case studies, 
and work on comparison of concepts just starts. What is still a drawback in many 
papers on robustness is the missing link to include the results of the experiments 
again in the design. 


1 Introduction 

Similar to the approach of stochastic optimization, robust optimization deals with mod¬ 
els in which the exact data is unknown, but bounded by a set of possible realizations 
(or scenarios). Contrary to the former approach, in robust optimization, one typically 
refrains from assuming a given probability distribution over the scenarios. While the 
first steps in robust optimization trace back to the work of Soyster [Soy73], it has not 
emerged as a field of research in its own right before the late 90s with the seminal works 
of Ben-Tal, Nemirovski, and co-authors (see [BTN98, BTN99], and many more). 
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In this section, we first describe the general setting of robust optimization in more 
detail, and then discuss the algorithm engineering methodology and its application, 
which gives a natural structure for the remainder of the paper. 

Uncertain optimization problems. Nearly every optimization problem suffers from un¬ 
certainty to some degree, even if this does not seem to be the case at first sight. Generally 
speaking, we may distinguish two types of uncertainty: Microscopic uncertainty, such as 
numerical errors and measurement errors; and macroscopic uncertainty, such as forecast 
errors, disturbances or other conditions changing the environment where a solution is 
implemented. 

In “classic” optimization, one would define a so-called nominal scenario, which de¬ 
scribes the expected or “most typical” behavior of the uncertain data. Depending on 
the uncertainty type, this scenario may be, e.g., the coefficient of the given precision for 
numerical errors, the measured value for measurement errors, the most likely forecast 
for forecast errors, or an average environment for long-term solutions. Depending on the 
application, computing such a scenario may be a non-trivial process, see, e.g., [JenOO]. 

In this paper we consider optimization problems that can be written in the form 

(P) min f{x) 

s.t. F{x) < 0 
X G X, 

where F : —)• MF describes the m problem constraints, / : MF —)• M is the objective 

function, and X C M"- is the variable space. In real-world applications, both the con¬ 
straints and the objective may depend on parameters which are uncertain. In order to 
accommodate such uncertainties, instead of (P), the following parameterized family of 
problems is considered: 


(-P(C)) min/(a;,C) 

s.t. F{x, 0 < 0 
X G X, 

where F{-,f) : M"" —)■ and : "SF -G M for any fixed ^ G Every ^ describes 

a scenario that may occur. 

Although it is in practice often not known exactly which values such a scenario may 
take for an optimization problem P{f,), we assume that it is known that lies within a 
given uncertainty set U C . Such an uncertainty set represents the scenarios which 
are likely enough to be considered. 

The uncertain optimization problem corresponding to P(^) is then denoted as 

( 1 ) 

Note that the uncertain optimization problem in fact consists of a whole set of parame¬ 
terized problems, that is often even infinitely large. The purpose of robust optimization 
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concepts is to transform this family of problems back into a single problem, which is 
called the robust counterpart. The choice of the uncertainty set is of major impact not 
only for the respective application, but also for the computational complexity of the 
resulting robust counterpart. It hence has to be chosen carefully by the modeler. 

For a given uncertain optimization problem G U), we denote by 

.T(C) = {xGAf:F(x,O<0} 

the feasible set of scenario ^ G U. Furthermore, if there exists a nominal scenario, it is 
denoted by ^ gU. The optimal objective value for a single scenario ^ gU is denoted by 

no- 

We say that an uncertain optimization problem (P(^), ^ G U) has convex (quasiconvex, 
affine, linear) uncertainty, when both functions, F{x, ■) : U ^ and f{x, ^ > M 

are convex (quasiconvex, affine, linear) in ^ for every fixed x G X. 

Common uncertainty sets. There are some types of uncertainty sets that are frequently 
used in current literature. These include: 

1. Finite uncertainty U = ..., 

2. Interval-based uncertainty ^ x ... x 

3. Polytopic uncertainty U = conv ..., 

4. Norm-based uncertainty ^ G : ||.^ — ^|| < a| for some parameter a > 0 

5. Ellipsoidal uncertainty = |^ G / fj? < nj' for some parameter 

II > 0 

6. Constraint-wise uncertainty lA = hli x ... x Um, where Ui only affects constraint i 

where conv A* = 1, A G denotes the convex hull 

of a set of points. Note that this classification is not exclusive, i.e., a given uncertainty 
set can belong to multiple types at the same time. 

The algorithm engineering methodology, and the structure of this paper. In the 

algorithm engineering approach, a feedback cycle between design, analysis, implementa¬ 
tions, and experiments is used (see [San09] for a detailed discussion). We reproduce this 
cycle for robust optimization in Figure 1. 

While this approach usually focuses on the design and analysis of algorithms, one 
needs to consider the important role that different concepts play in robust optimization. 
Moreover, as is also discussed later, there is a thin line between what is to be considered 
a robustness concept, and an algorithm - e.g., the usage of a simplified model for a ro¬ 
bustness concept could be considered as a new concept, but also as a heuristic algorithm 
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Figure 1: The algorithm engineering cycle for robust optimization following [San09] 
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for the original concept. We will therefore consider the design and analysis of both, 
concepts and algorithms. 

The algorithm engineering approach has been successfully applied to many problems 
and often achieved impressive speed-ups (as in routing algorithms, see, e.g. [DSSW09] 
and the book [MHSIO]). 

Even though this aspect has not been sufficiently acknowledged in the robust opti¬ 
mization community, the algorithm engineering paradigm fits very well in the line of 
research done in this area: In algorithm engineering it is of particular importance that 
the single steps in the depicted cycle are not considered individually, but that special 
structure occurring in typical instances is identified and used in the development and 
analysis of concepts and algorithms. As we will show in the following sections these 
links to real-world applications and to the structure of the uncertain data are of special 
importance in particular in robust optimization. Various applications with different un¬ 
derstandings of what defines a robust solution triggered the development of the different 
robustness concepts (see Section 2) while the particular structure of the uncertainty set 
led to adapted algorithms (see Section 3.1). 

Moreover, the algorithm engineering cycle is well-suited to detect the missing research 
links to push the developed methods further into practice. A key aspect of this paper 
hence is to draw further attention to the potential of algorithm engineering for robust 
optimization. 

We structure the paper along the algorithm engineering cycle, where we discuss each 
step separately, providing a few exemplarily papers dealing with the respective matters. 
Missing links to trigger further research in this areas are pointed out. Specifically, we 
consider 

• design of robustness concepts in Section 2, 

• analysis of robustness concepts in Section 3, 

• design and analysis of algorithms in Section 4, and 

• implementations and experiments in Section 5. 

Applications of robust optimization are various, and strongly influenced the design of 
robustness concepts while the design of algorithms was rather driven by an analysis of 
the respective uncertainty sets. Some of these relations are mentioned in the respective 
sections. The paper is concluded in Section 6 where we also demonstrate on some 
examples how the previously mentioned results can be interpreted in the light of the 
algorithm engineering methodology. 

2 Design of Robustness Concepts 

Robust optimization started with rather conservative concepts hedging against every¬ 
thing that is considered as being likely enough to happen. Driven by various other 
situations and applications calling for “robust” solutions these concepts were further 
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developed. In this section we give an overview on the most important older and some 
recent concepts. We put special emphasis on the impact applications with uncertain 
data have on the design of robustness concepts (as depicted in in Figure 1), and how 
real-world requirements influence the development of robustness models. 

2.1 Strict Robustness 

This approach, which is sometimes also known as classic robust optimization, one-stage 
robustness, min-max optimization, absolute deviation, or simply robust optimization, 
can be seen as the pivotal starting point in the field of robustness. A solution x G A 
to the uncertain problem (F’(^),^ G U) is called strictly robust if it is feasible for all 
scenarios in U, i.e. if F{x,^) < 0 for all ^ £ U. The objective usually follows the 
pessimistic view of minimizing the worst-case over all scenarios. Denoting the set of 
strictly robust solutions with respect to the uncertainty set U by 

Si{U) = f| 

i&u 

the strictly robust counterpart of the uncertain optimization problem is given as 

(SR) min sup 

s.t. X G SR(^) 

X £ X. 

The hrst to consider this type of problems from the perspective of generalized linear 
programs was Soyster [Soy73] for uncertainty sets U of type 

U = Ki X ... X Kn, 

where the set Ki contains possible column vectors Ai of the coefficient matrix A. 
Subsequent works on this topic include [Fal76] and [ThuSO]. 

However, building this approach into a strong theoretic framework is due to a series 
of papers by Ben-Tal, Nemirovski, El Ghaoui and co-workers [GL97, BTN98, BTN99, 
BTNOO]. A summary of their results can be found in the book [BTGN09]. Their basic 
underlying idea is to hedge against all scenarios that may occur. As they argue, such an 
approach makes sense in many settings, e.g., when constructing a bridge which must be 
stable, no matter which traffic scenario occurs, or for airplanes or nuclear power plants. 
However, this high degree of conservatism of strict robustness is not applicable to all 
situations which call for robust solutions. An example for this is timetabling in public 
transportation: being strictly robust for a timetable means that all announced arrival 
and departure times have to be met, no matter what happens. This may mean to add 
high buffer times, depending on the uncertainty set used, and thus would not result 
in a practically applicable timetable. Such applications triggered research in robust 
optimization on ways to relax the concept. We now describe some of these approaches. 
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2.2 Cardinality Constrained Robustness 

One possibility to overcome the conservatism of strict robustness is to shrink the uncer¬ 
tainty set lA. This has been conceptually introduced by Bertsimas and Sim in [BS04] for 
linear programming problems. Due to this reason, this concept is sometimes also known 
as “the approach of Bertsimas and Sim”, sometimes also under the name “T-robustness”. 
Analyzing the structure of uncertainty sets in typical applications, they observed that it 
is unlikely that all coefficients of one constraint change simultaneously to their worst-case 
values. Instead they propose to hedge only against scenarios in which at most T uncer¬ 
tain parameters per constraint change to their worst-case values, i.e., they restrict the 
number of coefficients which are allowed to change leading to the concept of cardinality 
constrained robustness. Considering a constraint of the form 

aiXi -I- ... -I- UnXn < b 


with an uncertainty U = {a G 'SA : ai G [di — di, di + di], i = 1,, n}, their robustness 
concept requires a solution x to satisfy 


n 


diXi -h 

i=l 


max 

5C{l,...,n}, 

\s\=r 


'^di\xi 

ies 


< b 


for a given parameter T G {0,..., n}. Any solution x to this model hence hedges against 
all scenarios in which at most T many uncertain coefficients may deviate from their 
nominal values at the same time. 

It can be shown that cardinality constrained robustness can also be considered as 
strict robustness using the convex hull of the cardinality-constrained uncertainty set 


UiV) = {a gU : Qi ^ di for at most T indices i} G U. 

Since conviUiV)) is a polyhedral set, results on strict robustness with respect to 
polyhedral uncertainty can also be applied to cardinality constrained robustness. 

Note that this approach also extends to fractional values of T. Their concept has 
been extended to uncertainty sets under general norms in [BPS04]. The approach to 
combinatorial optimization problems has been generalized in [Ata06] and [GST12]. 


2.3 Adjustable Robustness 

In [BTGGN03] a completely different observation of instances occurring in real-world 
problems with uncertain data is used; Often the variables can be decomposed into 
two sets. The values for the here-and-now variables have to be found by the robust 
optimization algorithm in advance, while the decision about the wait-and-see variables 
can wait until the actual scenario ^ G U becomes known. Note that this is similar to 
two-stage programming in stochastic optimization. 

We therefore assume that the variables x = (u, v) are splitted into u G C M"-! and 
V G X^ C m -\- n 2 = n, where the variables u need to be determined before 
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the scenario ^ £U becomes known, while the variables v may be determined after ^ has 
been realized. Thus, we may also write x(^) to emphasize the dependence of v on the 
scenarios. The uncertain optimization problem G U) is rewritten as 

P{C) min/(n,u,0 

F{u,v,^) < 0 
{u,v) G X 


When fixing the here-and-now variables, one has to make sure that for any possible 
scenario ^ G W there exists v G such that {u, v) is feasible for The set of adjustable 
robust solutions is therefore given by 

sSR = {u e e U 3v e s.t. {u, v) G JG(^)} 

= f| Pr;,i(.T(0), 

i&A 


where Prx^{P{C)) = G X^ : 3v G s.t. {u,v) G .T(,f)} denotes the projection of 
P{i) on XK 

The worst case objective for some u G aSR is given as 


2 ;^(u) = sup 
i&A 


inf 

v:(u,v)€J^(() 


f(u,v,0- 


The adjustable robust counterpart is then given as 

min{z^(u) : u G aSR}. 


Note that this setting is also useful for another type of problem instances, namely, if 
auxiliary variables are used that do not represent decisions, e.g., additional variables to 
model the absolute value of a variable. 

There are several variations of the concept of adjustable robustness. Instead of two 
stages, multiple stages are possible. In the approach of finitely adaptable solutions 
[BCIO], instead of computing a new solution for each scenario, a set of possible static 
solutions is computed, such that at least one of them is feasible in each stage. 

Furthermore, the development of adjustable robustness was preceded by the similar 
approach of Mulvey et al [MVZ95]. They considered an uncertain linear optimization 
problem of the form 

(P(i3,C', e)) min + 
s.t. Au = b 

Bu + Cv = e 
u G Rl\v G 


where u represents a vector of design variables that cannot be adjusted, and v a vector 
of control variables that can be adjusted when the realized scenario becomes known. For 



a finite uncertainty set U = {{B^, C^,e^),..., , e^)}, their robust counterpart 

is given as 

(Mul) min a{u, v^,..., v^) + iop{z^, ■ ■ ■, z^) 
s.t. Au = b 

B^u + + / = e* Vi = 1,..., iV 

The variables z* are introduced to measure the infeasibility in every scenario, i.e., the 
deviation from the right-hand side. The function a represents the solution robustness. 
It can be modeled as a worst-case function of the nominal objective 

a(u,v^,... ,v^) = c^u + max 

or, when probabilities p* are known, as an expected nominal objective. The function p 
on the other hand represents the model robustness and depends on the infeasibility of 
the uncertain constraints. Possible penalty functions are 

N m 

max{0, zj} 

i=l j=l 
N 

Y.Pt(z-)‘z‘. 

i=l 

As (Mul) is actually a bicriteria model, oj is used as a scalarization factor to combine 
both objectives. 

2.4 Light Robustness 

The lightly robust counterpart of an uncertain optimization problem, as developed in 
[FM09] and generalized in [Schl4] is again application driven. Originally developed 
for timetabling, the idea of light robustness is that a solution must not be too bad in 
the nominal case. For example, the printed timetable should have short travel times 
if everything runs smoothly and without disturbances; or a planned schedule should 
have a small makespan. In this sense a certain nominal quality is fixed. Among all 
solutions satisfying this standard, the concept asks for the most “reliable” one with 
respect to constraint violation. Specifically, the general lightly robust counterpart as 
defined in [Schl4] is of the following form: 

m 

(LR) min ^ Wi'ji 

i=l 

s.t. f{x,i)<f*{i) + p 

X G A,7 G M™, 


p{z^,...,z^) = 


or = 
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where Wi models a penalty weight for the violation of constraint i and p determines the 
required nominal quality. We denote by ^ the nominal scenario, as introduced on page 3. 
This approach was in its first application in [FM09] used as a further development of 
the concept of cardinality constrained robustness (see Section 2.2). 

Note that a constraint of the form F{x, ^) < 0 is equivalent to a constraint XF{x, .^) < 0 
for any A > 0; therefore, the coefficients Wi play an important role in balancing the 
allowed violation of the given constraints. 

2.5 Recoverable Robustness 

Similar to adjustable robustness, recoverable robustness is again a two-stage concept. 
It has been developed in [CDS'''07, StiOS, LLMS09, DDN09] and has independently also 
been used in [EMS09]. Its basic idea is to allow a class of recovery algorithms A that 
can be used in case of a disturbance. A solution x is called recovery robust with respect 
to A if for any possible scenario ^ £ U there exists an algorithm A £ A such that A 
applied to the solution x and the scenario constructs a solution A{xA) £ -^( 0 ) i-®-) ^ 
solution which is feasible for the current scenario. 

The recovery robust counterpart according to [LLMS09] is the following: 

(RR) min f{x) 

{x,A)&T{i)xA 

s.t. A(x ,0 G -^(0 VC 

It can be extended by including the recovery costs of a solution x: Let d{A{xA)) be a 
possible vector-valued function that measures the costs of the recovery, and let A G A 
be a limit on the recovery costs, i.e., A > d(A(x,C)) for all ^ £U. Assume that there is 
some cost function 5 : ; A —)■ M associated with A. 

Setting 

A(x,C,A)G.T'(C) ^ d{A{xA))<\ A yl(x,C)G J-(e) 
gives the recovery robust counterpart with limited recovery costs: 

(RR-LIM) min f{x) + g{\) 

(x,A,A)eJ'(0x-4xA 

S.t. A(x,C,A) G.F'(C) VC GLf. 

Due to the generality of this robustness concept, the computational tractability heav¬ 
ily depends on the problem, the recovery algorithms and the uncertainty under con¬ 
sideration. In [GSIO, GSlIa, Goel2, GSI4], the concept of recoverable robustness has 
been considered under the usage of metrics to measure recovery costs. The aim is to 
minimize the costs when recovering, where they differ between recovering to a feasible 
solution (“recovery-to-feasibility”), and recovering to an optimal solution (“recovery-to- 
optimality”) in the realized scenario. 
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2.6 Regret Robustness 

The concept of regret robustness differs from the other presented robustness concepts 
insofar it usually only considers uncertainty in the objective function. Instead of min¬ 
imizing the worst-case performance of a solution, it minimizes the difference to the 
objective function of the best solution that would have been possible in a scenario. In 
some publications, it is also called deviation robustness. 

Let f*{^) denote the best objective value in scenario ^ £ U. The min-max regret 
counterpart of an uncertain optimization problem with uncertainty in the objective is 
then given by 

(Regret) min sup - f*{0) 

s.t. F{x) < 0 
X G X. 

Regret robustness is a concept with a vast amount of applications, e.g., in location theory 
or in scheduling. For a survey on this concept, see [ABV09] and [KY97]. In a similar 
spirit, the concept of lexicographic a-robustness has been recently proposed [KLV12]. 
Its basic idea is to evaluate a fixed solution by reordering the set of scenarios according 
to the performance of the solution. This performance curve is then compared to an ideal 
curve, where the optimization problem is solved separately for every scenario. 

2.7 Some Further Robustness Concepts 

Reliability. Another approach to robust optimization is to relax the constraints of strict 
robustness. This leads to the concept of reliability of Ben-Tal and Nemirovski [BTNOO], 
in which the constraints F{x,^) < 0 are replaced by F{x,^) < 7 for some 7 G K>o- ^ 
solution X which satisfies 

F{x,^) < 7 for all ^ G 77 

is called reliable with respect to 7 . The goal is to find a reliable solution which minimizes 
the original objective function in the worst case. Similar to light robustness, one has 
to be careful that the representation of the constraints does not affect the reliability of 
the solution, otherwise one may obtain the counter-intuitive result that, although the 
constraints F{x,^) < 0 can also be written as '^{F{x,^)) < 0 for any increasing T with 
'k(O) = 0, what is understood by a robust solution may be different if one models the 
constraints with F or with ^(F). 

Soft Robustness. The basic idea of soft robustness as introduced in [BTBBIO] is to 
handle the conservatism of the strict robust approach by considering a nested family of 
uncertainty sets, and allowing more deviation in the constraints for larger uncertainties. 
Specifically, instead of an uncertainty set 77 C a family of uncertainties {77(e) C 
77 }£>o with 77(ei) G 77 (e 2 ) for all 62 > £1 is used. The set of soft robust solutions is then 
given as 

softR = {x G X : F{x, ^) < £ yf G 77(e), e > 0} . 
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Note that strict robustness is a special case with hl{£) =U for all e > 0. 

In [BTBBIO], the authors show that a solution to the softly robust counterpart - 
i.e., the optimization over softR with a worst-case objective - can be found by solving a 
sequence of strictly robust counterparts using a bisection approach over e, and analyze 
the numerical performance on a bond portfolio and an asset allocation problem. 

Comprehensive Robustness. While the adjustable robust approach relaxes the as¬ 
sumption that all decisions have to be made before the realized scenario becomes known, 
the approach of comprehensively robust counterparts [BTBN06] also removes the as¬ 
sumption that only scenarios defined in the uncertainty set lA need to be considered. 
Instead, using a distance measure dist in the space of scenarios, and a distance measure 
dist in the solution space, they assume that the further away a scenario is from the un¬ 
certainty set, the further away the corresponding solution is allowed to be from the set 
of feasible solutions. As in adjustable robustness, the dependence of x on the scenario 
^ is allowed, and we may write x{^). The adjustable robust counterpart is extended to 
the following problem: 

(CRC) min 2 : 

s.t. /(x(0,0 < ^ + oiQdist{i,U) 

dist{x{^),T{^)) < adist{^,lA) V^, 

where a, ao denote sensitivity parameters. This formulation needs further formal speci¬ 
fication, which is provided in [BTBN06]. 

Uncertainty Feature Optimization. Instead of assuming that an explicit uncertainty 
set is given, which may be hard to model for real-world problems, the uncertainty feature 
optimization (UFO) approach [ESBll] rather assumes that the robustness of a solution 
is given by an explicit function. For an uncertain optimization problem let 

/i : MA —)• be a measure for p robustness features. The UFO-counterpart of the 

uncertain problem is then given by 

(UFO) vecmax p{x) 

s.t. F{x) < 0 

f{x)<{i + p)r{i) 

X G T, 

where f*{^) denotes the best objective value to the nominal problem. The authors 
show that this approach generalizes both stochastic optimization and the concept of 
cardinality constrained robustness of Bertsimas and Sim. 

2.8 Summary 

As this section shows, we cannot actually speak of one concept or point-of-view to be 
“robust optimization”; instead, we should see it as a vast collection of different robust¬ 
ness concepts, each providing their unique advantages and disadvantages. Generally 
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speaking, there is usually a trade-ofF between the degree of freedom a concept gives 
to react to disruptions (including what is considered as being a disruption, i.e., the 
choice of the uncertainty set), and its computational complexity. From an algorithm 
engineering point of view, the size of this “toolbox” of different concepts significantly 
helps with finding a suitable robustness concept for a given problem. However, as these 
concepts are usually application-driven, they lack a generalizing systematics; Appli¬ 
cations tend to develop “their own approach” to robustness instead of making use of 
the existing body of literature, and develop their own notation and names along the 
way. In fact, the very same concepts are known under plenty of names. Summaries 
as [BTGN09, ABV09,BBCll,Royl0] usually avoid this Babylonian “zoo” of robustness 
concepts and nomenclature by focusing only on the mainstream concepts. Thus, we 
suggest the following pointer to further research: 

Remark 1 Robust optimization needs a unified elassification seheme. 

3 Analysis of Robustness Concepts 

Not only the development of robustness concepts, but also their analysis is data-driven. 
This becomes in particular clear when looking at the structure of the underlying uncer¬ 
tainty set. A large amount of research in the analysis of robustness concepts is devoted 
to hnding equivalent problem formulations that are better tractable, using the structure 
of the uncertainty set. 

In this section we first review this line of research, and then briefly point out exem- 
plarily which other types of structure or ideas have been used in the analysis of concepts. 

3.1 Using the structure of the uncertainty set 

Finite uncertainty set. If the uncertainty set U = ..., is a finite set containing 

not too many scenarios, most of the robustness concepts can be formulated as mathe¬ 
matical programs by just adding the constraints for each of the scenarios explicitly. This 
can straightforwardly been done for strict robustness yielding 

(SR) min z 

s.t. /(x,^*) < z for f = 1 ,..., A" 

s.t. F{x,C) < 0 fori = l,...,A 

X G A. 

as the strictly robust counterpart. Reliability and light robustness can be treated anal¬ 
ogously. In all three cases, the robust counterpart keeps many properties of the original 
(non-robust) problem formulation: If the original formulation was e.g., a linear program, 
also its robust counterpart is. The same holds for differentiability, convexity, and many 
other properties. 

For regret robustness one needs to precompute the best objective function value for 
each scenario ^^,i = 1,... ,N in order to receive again a straightforward reformulation. 
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Also in adjustable and recoverable robustness mathematical programming formulations 
can be derived by adding a wait and see variable, or a group of recovery variables for 
each of the scenarios. This usually leads to a high number of additional variables but is 
(at least for linear programming) often still solvable. 

Note that the concept of cardinality constrained robustness does not make much sense 
for a finite set of scenarios since it concerns the restriction which scenarios might oc¬ 
cur. For a finite set, scenarios in which too many parameters change can be removed 
beforehand. 

Polytopic uncertainty. Let f{x, ■) and F{x, ■) be quasiconvex in ^ for any fixed x G X. 
Then there are robustness concepts in which the following reduction result holds: The 
robust counterpart w.r.t. an uncertainty set W is equivalent to the robust counterpart 
w.r.t. U := conv{U'). In such cases the robust counterpart w.r.t. a polytopic uncer¬ 
tainty set U = conv{^^,... is equivalent to the robust counterpart w.r.t. the finite 
uncertainty set ... ,C^}, hence the formulations for finite uncertainty sets can be 
used to treat polytopic uncertainties. 

We now review for which robustness concepts the reduction result holds. First of all, 
this is true for strict robustness. For affine and convex uncertainty this was mentioned 
in [BTN98]; the generalization to quasiconvex uncertainty is straightforward. One of the 
direct consequences, namely that the robust counterpart of an uncertain linear program 
under these conditions is again a linear program was mentioned in [BTNOO]. The same 
result holds for reliability since the reliable robust counterpart can be transformed to a 
strictly convex counterpart by dehning F{x,^) = F{x,^) — 7 . For light robustness, the 
result is also true, see [Schl4]. For the case of adjustable robustness, [BTGGN03] showed 
that the result holds for problems with fixed recourse. Otherwise, counterexamples can 
be constructed. The generalization to nonlinear two-stage problems and quasiconvex 
uncertainty is due to [TTT08]. For recoverable robustness there exist special cases in 
which the recovery robust counterpart is equivalent to an adjustable robust counterpart 
with hxed recourse. In these cases, the result of [BTGGN03] may be applied. However, 
in general, recoverable robustness does not allow this property. This also holds for 
recovery-to-optimality. 

Interval-based uncertainty. Interval-based uncertainty can be interpreted as a special 
case of polytopic uncertainty where the polytope is a box U = x ... x 

with 2^ extreme points (^ 1 ,^ 2 , • • • ,CmY £ , where G = 1,... ,M. Hence, 

all the results for polytopic uncertainty apply. They can often be simplified by observing 
that not all extreme points are needed since the respective constraints often dominate 
each other, yielding a drastic speed-up when solving the robust counterpart. 

For their concept of cardinality constrained robustness, Bertsimas and Sim [BS04] 
considered interval-based uncertainty sets for linear programs. This can be interpreted as 
strict robustness with a new uncertainty set U' only allowing scenarios in which not more 
than F uncertain parameters per constraint change their values (see also [BPS04]). This 
uncertainty set U' is a polytope, hence the robust counterpart for cardinality constrained 
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robustness stays a linear program for interval-based uncertainty. 


Ellipsoidal uncertainty. The case of ellipsoidal uncertainty is studied extensively for 
strict robustness and for adjustable robustness in [BTGN09]. It could be shown that 
often the constraint 

F{x, 0 < 0 for alU G 

can be replaced by a finite number of constraints for ellipsoidal uncertainty sets. How¬ 
ever, it has been shown in [BTGN09] that for ellipsoidal uncertainty, the structure of 
the strictly robust counterpart gets more complicated. For example (see [BTN98]) the 
strictly robust counterpart of a linear program is a conic quadratic program, the strictly 
robust counterpart of a quadratic constrained quadratic program is a semidefinite pro¬ 
gram, the strictly robust counterpart of a second order cone program is a semidefinite 
program, and the strictly robust counterpart of a semidefinite program is NP-hard. As 
mentioned before, all these results can be transferred to reliability. 

For light robustness, it has been shown in [Schl4] that the lightly robust counterpart of 
a linear program with ellipsoidal uncertainty becomes a quadratic program. Ellipsoidal 
uncertainty could receive more attention also for other robustness concepts (e.g., for 
regret robustness, which usually only considers finite or interval-based uncertainty, see 
[ABV09]), or for adjustable robustness, see [BTGN09]. 

3.2 Using duality 

Duality in uncertain programs has been considered as early as 1980, see [Thu80]. In 
[BBT09], it is shown that “the primal worst equals the dual best”, i.e., under quite gen¬ 
eral constraints, the dual of a strictly robust counterpart (a min-max problem) amounts 
to optimization under the best case instead of the worst-case (a max-min problem). Since 
then, duality in robust optimization has been a vivid field of research, see, e.g., [JLS13] 
and [SKL13]. In the following, we highlight two applications of duality for robust opti¬ 
mization: One for constraints, and one for objectives. 

Duality in the constraints. 

Duality is a useful tool for the reformulation of robust constraints. We exemplarily 
demonstrate this using two applications. 

In [BS04], the authors show that the cardinality constrained robust counterpart can 
be linearized by using the dual of the inner maximization problem. This yields 

n n 

ciiXi+zT+< b 

i=l i=l 

z + pi>diyi Vf = l,...,n 

- Vi < Xi < Hi Vi = 1,... ,n 
p,y,z> 0. 


15 



Note that a general, robust constraint of the form 

f{x,o<oy^eu 

can be rewritten as 

max/(x, < 0. 
i&u 

This is used in [BTdHV14]. With a concave function /(x, •) and an uncertainty set 
U = {£, + AQ : C G Z} with a nonempty, convex and compact set Z, applying duality 
yields 

+ 5*{A^v\Z) — /*(u,x) < 0 

where S* is the support function, /* is a conjugate function, and other technical require¬ 
ments are met. This gives a very general tool to compute robust counterparts; e.g., 
a linear constraint of the form /(x, — j3 and Z = {Q : ||(j ||2 < p} yields the 

counterpart ^*x -|- p||A*x ||2 < (3. 

Duality in the objective. 

In many papers, duality is used to change the typical min-max objective of a robust 
counterpart into a min min objective by using the dual formulation of the inner maxi¬ 
mization problem. 

This method was first applied to the spanning tree problem [YKPOl], and later ex¬ 
tended to the general case of optimization problems with zero duality gap in [ABV09]. 
Let an uncertain optimization problem of the form 

min c*x 

s.t. X G X = {x G {0, 1}"" : Ax > b} 

with interval-based uncertainty in c be given; i.e., c* G [c^,Ci\^ Then we may write 

min max (/(x, c) — f* (c)) 

= min max fc*x — 
x&x ceu,yex ^ ' 

= min ( cx — min c^^(x)v I , 
x£X \ y£X ^ J 

where c""^(x) denotes the regret worst-case for x, given as q if x* = 1, and Cj if x* = 0. 
Using that the duality gap is zero, we can insert the dual to the inner optimization 
problem, and get the following equivalent problem; 

min cx — b^y 
s.t. Ax > b 

A^y < (c — c)x -f c 
X G {0,ir,y G 

This reformulation can then be solved using, e.g., a branch and bound approach. 
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4 Design and Analysis of Algorithms 


Concerning the design and analysis of algorithms we concentrate on the most mature 
concept, namely on algorithms for strict robustness. Many approaches, often based on 
similar ideas, also exist for regret optimization - e.g., cutting plane approaches [IS95, 
ML99,ML98], or preprocessing considerations [YKPOl,KZIO]. For the other concepts, 
approaches are currently still being developed. 

The robust counterpart per se is a semi-infinite program; thus, all methods that apply 
to semi-infinite programming [LS07] can be used here as well. However, the special min- 
max structure of the robust counterpart allows improved algorithms over the general 
case, in particular for the reformulations based on special uncertainty sets as mentioned 
in Section 3.1. 

In the following, we discuss algorithms that are generically applicable to strictly robust 
optimization problems. 

4.1 Finite Scenarios 

The case we consider here is that U = is a finite set; i.e., the strictly robust 

counterpart (SR) can be rewritten as 

min max f(x,C) 

s.t. F{x,C) <0Vi = l,...,iV 

X € X 

Due to the lack of structure in the uncertainty set, these instances can be hard so solve, 
even though they have a similar structure as the nominal problem. 

4.1.1 Branch and bound using surrogate relaxation. 

The following approach was introduced by [KY97] for discrete optimization problems 
with uncertainty only in the objective: For any vector ^ G the surrogate relaxation 
SRC(/r) of (SR) with uncertain objective function is given by 

SRC(/i) min — 

s.t. F{x) < 0 
X G X 

Note that the structure of the nominal problem is preserved, which allows the us¬ 
age of specialized algorithms already known. Furthermore, the optimal objective value 
SRC*(;u) of this problem is a lower bound on the optimal objective value SR* of the 
strictly robust counterpart; and as the set of feasible solutions is the same, also an upper 
bound is provided by solving SRC(/i). 
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This approach is further extended by solving the problem 


max SRC*(;u), 

i.e., by finding the multiplier /x that yields the strongest lower bound. This can be done 
using a sub-gradient method. 

The lower and upper bounds generated by the surrogate relaxation are then used 
within a branch and bound framework on the x variables. The approach was further 
improved for the knapsack problem in [Iid99, TYK08]. 

4.1.2 Local search heuristics. 

In [SbilO], a local search-based algorithm for the knapsack problem with uncertain objec¬ 
tive function is developed. We briefly list the main aspects. It makes use of two different 
search procedures: Given a feasible solution x and a list of local neighborhood moves 
M, let GS{x,M) (the generalized search) determine the worst-case objective value of 
every move, and return the best move along with its objective value. Furthermore, let 
RS{x,M,S) (the restricted search) perform a random search using the moves M with 
at most S steps. 

The cooperative local search algorithm (CLS) works as follows: It first constructs a 
heuristic starting solution, e.g., by a greedy approach. In every iteration, a set of moves 
M is constructed using either the generalized search for sets with small cardinality, or the 
restricted search for sets with large cardinality. When a maximum number of iterations 
is reached, the best feasible solution found so far is returned. 

4.1.3 Approximation algorithms. 

A discussion of approximation algorithms for strict robustness with finitely many scenar¬ 
ios is given, e.g., in [ABV07], where it is shown that there is an FPTAS for the shortest 
path, the spanning tree, and the knapsack problem when the number of scenarios is 
constant; but the shortest path problem is not (2 — e)-approximable, the spanning tree 
problem is not (| — e)-approximable, and the knapsack problem is not approximable at 
all when the number of scenarios is considered as a non-constant input. 

The basic idea for their results is to use the relationship between the strictly robust 
counterpart (SR) and multi-objective optimization: At least one optimal solution for 
(SR) is also an efficient solution in the multi-objective problem where every scenario is an 
objective. Thus, if the multi-objective problem has a polynomial-time a-approximation 
algorithm, then also (SR) has a polynomial-time a-approximation. 

There exist many more approximation algorithms for specific problems. For example, 
in [FJMM07], robust set covering problems are considered with implicitly given, expo¬ 
nentially many scenarios. For a similar setting of exponentially many, implicitly given 
scenarios for robust network design problems (e.g., Steiner tree), [KKMS13] presents ap¬ 
proximation results. Approximation results using finite scenario sets for two-stage robust 
covering problems, min-cut and shortest path can be found in [DGRS05] and [GGP'’“14]. 
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4.2 Infinite Scenarios 

4.2.1 Sampling. 

When we cannot make use of the structure of lA (i.e., when the reformulation approaches 
from Section 3 cannot be applied, or when we do not have a closed description of the set 
available), we can still solve (SR) heuristically using a finite subset of scenarios (given 
that we have some sampling method available). The resulting problem can be solved 
using the algorithms described in Section 4.1. 

In a series of paper [CC05,CC06,CG08,Call0], the probability of a solution calculated 
by a sampled scenario subset being feasible for all scenarios is considered. It is shown 
that for a convex uncertain optimization problem, the probability of the violation event 
V{x) = P{^ elJ : X ^ can be bounded by 

PiV(x-) > e) < x) (") «‘(1 - 

where N is the sample size, x* G MA is an optimal solution with respect to the sampled 
scenarios, and n is (as before) the dimension of the decision space. Note that the left- 
hand side is the probability of a probability; this is due to fact that V{x) is a random 
variable in the sampled scenarios. In other words, if a desired probability of infeasibility 
e is given, the accordingly required sample size can be determined. This result holds 
under the assumption that every subset of scenarios is feasible, and is independent of 
the probability distribution which is used for sampling over lA. 

As the number of scenarios sampled this way may be large, the sequential optimization 
approach [FW07, FW09a, FW09b] uses sampled scenarios one by one. Using the above 
probability estimates, a solution generated by this method is feasible for (SR) only within 
a certain probability. The basic idea is the following; We consider the set 5 ( 7 ) of feasible 
solutions with respect to a given quality level 7 , i.e., 

5 ( 7 ) = {x G T : f{x) < 7 , F(x, C) < 0 G 7/} 

= {x G T : jv(7, X, ^) < 0 V.^ G U} 


where 

z^( 7 , X, i) = (max{ 0 , /(x) - 7 }^ max{ 0 , F(x, C)}^) 

Using a subgradient on u, the current solution is updated in every iteration using the 
sampled scenario Lower bounds on the number of required iterations are given to 
reach a desired level of solution quality and probability of feasibility. 

4.2.2 Outer-approximation and cutting-plane methods. 

For this type of algorithm, the general idea is to iteratively a) solve a robust optimization 
problem with a finite subset of scenarios, and b) use a worst-case oracle that optimizes 
over the uncertainty set lA for a given solution x. These steps can be done either exactly 
or approximately. 
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Algorithms of this type have often been used, see, e.g., [Ree94,MB09,BNAl4,SAGll, 
GDT15, Mon06, FM12]; sometimes even without knowledge that such an approach al¬ 
ready exists (see also the lacking unihcation in robust optimization mentioned in Sec¬ 
tion 2.8). 

The following general results should be mentioned. [MB09] show that this method 
converges under certain assumptions, and present further variations that improve the 
numerical performance of the algorithm. Cutting-plane methods are compared to com¬ 
pact formulations on general problem benchmarks in [FM12]. In [BNA14], the imple¬ 
mentation is considered in more detail: A distributed algorithm version is presented, in 
which each processor starts with a single uncertain constraint, and generated cutting 
planes are communicated. 

4.3 Algorithms for Specific Problems 

The goal of this section is to show how much one can benefit by using the structure 
a specific problem might have. To this end, we exemplarily chose three specialized 
algorithms: The first solves an NP-hard problem in pseudo-polynomial time, the second 
is a heuristic for another NP-hard problem, and the third is a polynomial-time solution 
approach. Note that many more such algorithms have been developed. 

In [MPS13], a dynamic programming algorithm is developed for the robust knapsack 
problem with cardinality constrained uncertainty in the weights. Extending the classic 
dynamic programming scheme to also include the number of items that are on their 
upper bounds, they are able to show a 0(Tnc) time complexity, where n is the number 
of items, and c is the knapsack budget (note that this is not a polynomial algorithm). 
The key idea of the dynamic program is an easy feasibility check of a solution, which is 
achieved by using an item sorting based on the upper weight bound Wi. In computational 
experiments, instances with up to 5000 items can be solved in reasonable time. 

The problem of min-max regret shortest paths with interval uncertainty is considered 
in [MG04]. The general idea is based on path ranking, and the conjecture that a path 
that ranks good on the worst-case scenario, may also rank good with respect to regret. 
Considering paths with respect to their worst-case performance order, they formulate a 
stopping criterion when the regret of a path may not improve anymore. Note that the 
regret of a single path can in this case easily be computed by assuming the worst-case 
length for all edges in the path, and the best-case length for all other edges. Experiments 
show a strong correlation between computation times and length of the optimal path. 

While the former two problems are NP-hard (for regret shortest path, see [Zie04]), 
a polynomial-time algorithm for the min-max regret I-center on a tree with uncertain 
edge lengths and node weights is presented in [ABOO]. A 1-center is a point on any edge 
of the tree for which the maximal weighted distance to all nodes is minimized. The 
algorithm runs in O(n^) time, which can be reduced to 0{'n? log(n)) for the unweighted 
case. It is based on the observation that an edge that contains an optimal solution can 
be found in 0(n^log(n)) time; however, determining its exact location for the weighted 
case is more complicated. 

Further algorithms to be mentioned here are the polynomial algorithm for min-max 


20 



regret flow-shop scheduling with two jobs from [Ave06]; the polynomial algorithm for 
the min-max regret location-allocation problem from [Con07]; the heuristic for regret 
spanning arborescences from [CC07]; the polynomial algorithm for the min-max regret 
gradual covering location problem from [BWll]; and the PTAS for two-machine flow 
shop scheduling with discrete scenarios from [KKZ12]. 

4.4 Performance Guarantees 

We now discuss performance guarantees in robust optimization. Measuring the perfor¬ 
mance of a robust solution or algorithm can be either done by developing guarantees 
regarding the performance of an algorithm or of a heuristic solution; but also by develop¬ 
ing performance guarantees that compare the solutions generated by different robustness 
concepts. 

On the algorithmic side, standard measures like the approximation ratio (i.e., the ra¬ 
tio between the robust objective value of the heuristic and the optimal robust solution) 
can be applied. There are simple, yet very general approximation algorithms presented 
in [ABV09] for strict robustness and regret robustness: If the original problem is poly- 
nomially solvable, there is an A^-approximation algorithm for finite uncertainty sets, 
where N is the number of scenarios. Furthermore, there is a 2-approximation algorithm 
for regret robustness with interval-based uncertainty [KZ06] by using the mid-point 
scenario. These results have been extended in [Conl2], see also the approximability 
survey [ABV07] on strict and regret robustness. We do not know of approximation al¬ 
gorithms for other robustness concepts, which would provide interesting insight in the 
structural differences between the robust counterparts. 

Regarding the comparison between solutions generated by different concepts, an in¬ 
teresting approach is to consider the quality of a strictly robust solution when used 
in an adjustable setting, as done in [BGIO, BGSll]. The authors are able to develop 
performance guarantees solely based on the degree of symmetry of the uncertainty set. 

Concerning the evaluation of a robust solution (and not the algorithm to compute it), 
there is no general consent how to proceed, and surprisingly little systematic research 
can be found regarding this field. The so-called robustness gap as considered in [BTN98] 
is defined as the difference between the worst-case objective of the robust solution, 
and the worst optimal objective value over all scenarios, i.e., as SR* — sup^g^/*(^), 
where SR* denotes the optimal value of (SR). They show that in the case of constraint- 
wise affine uncertainty, a compact set X, and some technical assumptions, this gap 
equals zero. However, the most widely used approach is computing the so-called price 
of robustness [BS04], which is usually defined as the ratio between the robust solution 
value and the nominal solution value, i.e., as 

min3,ga^supgg^/(x,0 

As an example, [MP13] presents the analytical calculation of the price of robustness 
for knapsack problems. Using an interval-based uncertainty set on the weights (i.e., the 
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weight of item i is in [wi—w.i-, Wi+Wi]) and a cardinality constrained robustness approach, 
they show that the price of robustness equals 1/(1 + \5max\) for 5max ■= max* Wifwi and 
r = 1. For r > 2, the price of robustness becomes 1/(1 + l26max~\}- 

Note that this is a rather pessimistic view on robustness, as it only concentrates on 
the additional costs of a robust solution compared to the nominal objective function 
value of an optimal solution for the nominal case. However, if the application under 
consideration is affected by uncertainty, the nominal solution will not necessarily find 
nominal conditions, hence the robust solution may actually save costs compared to the 
nominal solution (which easily may be even infeasible). There is no general “golden 
rule” that would provide a fair evaluation for the performance of a robust solution. 

Note that such a bound is not the kind of performance guarantee that was actually 
considered in [BS04]. Rather, they developed probability bounds for the feasibility of 
a solution to the cardinality constrained approach depending on F. Using such bounds 
they argue that the nominal performance of a solution can be considerably increased 
without decreasing the probability of being feasible too much. 

Summarizing the above remarks, we claim that; 

Remark 2 Performance guarantees are not sufficiently researched in robust optimiza¬ 
tion. 


5 Implementation and Experiments 

5.1 Libraries 

In the following, we present some libraries that are designed for robust optimization. A 
related overview can also be found in [Goel4b]. 

AIMMS for Robust Optimization. AIMMS [Parl2], which stands for “Advanced In¬ 
teractive Multidimensional Modeling System”, is a proprietary software that contains an 
algebraic modeling language (AML) for optimization problems. AIMMS supports most 
well-known solvers, including Cplex^, Xpress^ and Gurobi^. 

Since 2010, AIMMS has offered a robust optimization add-on, which was developed 
in a partnership with A. Ben-Tal. The extension only considers the concepts of strict 
and adjustable robustness as introduced in Sections 2.1 and 2.3. As uncertainty sets, 
interval-based uncertainty sets, polytopic uncertainty sets, or ellipsoidal uncertainty sets 
are supported and transformed to mathematical programs as described in Section 3.1. 
The respective transformations are automatically done when the model is translated 
from the algebraic modeling language to the solver. 


^ http: / / www-03.ibm.com / software / products/en/ibmilogcpleoptistud 
^ http: / / www.fico.com/en / products/fico-xpress-optimization-suite 
®http://www.gurobi.com/ 
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ROME. While AIMMS focuses on the work of Ben-Tal and co-workers, ROME [GSllb] 
(“Robust Optimization Made Easy”) takes its origins in the work of Bertsimas, Sim and 
co-workers. ROME is built in the MATLAB^ environment, which makes it on the one 
hand intuitive to use for MATLAB-users, but on the other hand lacks the versatility 
of an AML. As a research project, ROME is free to use. R currently supports Cplex, 
Xpress and SDPT3^ as solver engines. 

ROME considers polytopic and ellipsoidal uncertainty sets, that can be further speci¬ 
fied using the mean support, the covariance matrix, or directional deviations. Assuming 
an affine dependence of the wait-and-see variables, it then transforms the uncertain op¬ 
timization problem to an adjustable robust counterpart. The strictly robust counterpart 
is included as a special case. 

YALMIP. Similar to ROME, YALMIP [Lofl2] is a layer between MATLAB and a 
solver that allows the modeling of optimization problems under uncertainty. Nearly all 
well-known solvers are supported, including Cplex, Gurobi and Xpress. 

YALMIP considers strict robustness. In order to obtain the strict robust counterpart 
of an uncertain optimization problems so-called filters are used: When presented a model 
with uncertainty, the software checks if one of these filters applies to generate the strictly 
robust counterpart. Currently, five of these automatic transformations are implemented. 
A duality filter (which adds dual variables according to Section 3.2), an enumeration 
filter for finite and polytopic scenario sets (which simply lists all relvant constraints), an 
explicit maximization filter (where a worst-case scenario is used), the Polya filter (which 
is based on an inner approximation of the set of feasible solutions), and an elimination 
filter (which sets variables affected by uncertainty to 0 and is used as a last resort). 

ROPI. The Robust Optimization Programming Interface (ROPI) [Goel4b,Goel3] is a 
C-|—|- library that provides wrapper MIP classes to support a range of solvers. Using 
these generic classes, a robust counterpart is automatically generated given the desired 
robustness concept and uncertainty set. Contrary to the previous libraries, a wider 
choice of robustness concepts is provided: These include strict robustness, adjustable 
robustness, light robustness, and different versions of recoverable robustness. 

Even though a user can pick and choose between multiple robust optimization libraries, 
there is to the best of our knowledge no library of robust optimization algorithms avail¬ 
able. All of the above implementations are based on reformulation approaches, which 
makes it possible to draw upon existing solvers. However, as described in Section 4, 
there are plenty of specifically designed algorithms for robust optimization available. 
Making them readily-implemented available to the user should be a significant concern 
for future work in robust optimization. 

Remark 3 There is no robust optimization library available with specifically designed 
algorithms other than reformulation approaches. 

^http: / / www.mathworks.com/products / matlab / 

®http://www.math.nus.edu.sg/'mattohkc/sdpt3.html 
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5.2 Applications 

As already stated, robust optimization has been application-driven; thus, there are abun¬ 
dant papers dealing with applications of some robustness approach to real-world or at 
least realistic problems. Presenting an exhaustive list would go far beyond the scope of 
this paper; examples include circuit design [MSO06], emergency logistics [BTCMYll], 
and load planning [BGKS14] for adjustable robustness; supply chain optimization [BT06] 
and furniture planning [AM12] for cardinality constrained robustness; inventory control 
for comprehensive robustness [BTGS09]; timetabling [FM09, FSZ09], and timetable in¬ 
formation [GKMH+ll] for light robustness; shunting [GDS'''07], timetabling [GDS“''09, 
GSIO], and railway rolling stock planning [GGG'*“12] for recoverable robustness; and 
airline scheduling for UFO [Egg09]. 

Hence, we can state; 

Remark 4 Robust optimization is application-driven. 

5.3 Comparative Experiments 

In this section we consider research that either compares two robustness concepts to 
the same problem, or two algorithms for the same problem and robustness concept. We 
present a list of papers on the former aspect in Table 1, and a list of papers on the latter 
aspect in Table 2. We do not claim completeness for these tables; rather, they should 
be considered as giving a general impression on recent directions of research. 

We conclude the following from these tables and the accompanying literature: Firstly, 
papers considering real-world applications that compare different robustness concepts 
are relatively rare. Applied studies are too often satisfied with considering only one 
approach of the many that are possible. Secondly, algorithmic comparisons dominantly 
stem from the field of min-max regret, where at the same time mostly academic problems 
are considered. The efficient calculation of solutions for other robustness concepts is still 
a relatively open and promising field of research. Summarizing, we claim that: 

Remark 5 There are too few comparative studies in robust optimization. 

A different aspect Table 1 reveals is that most computational studies comparing at 
least two robustness concepts include strict robustness as a “baseline concept”; accord¬ 
ingly, and unsurprisingly, the more tailor-made approaches will show an improved be¬ 
havior for the application at hand. This is much similar to frequently published papers 
on optimization problems which compare a problem-specific method to a generic MIP 
solver, usually observing a better performance of the former compared to the latter. 

However, while a standard MIP solver is often still competitive to problem-tailored 
algorithms, a robustness concept which does not capture the problem specifics at hand 
will nearly always be the second choice to one which uses the full problem potential. 
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Table 2: Papers presenting experiments comparing at least two algorithms for the same robustness concept, “cc” abbreviates 
“cardinality constrained”. 



5.4 Limits of Solvability 

We show the approximate size of benchmark instances used for testing exact algorithms 
for a choice of robust problems in Table 3. These values should rather be considered as 
rough indicators on the current limits of solvability than the exact limits themselves, as 
problem complexities are determined by many more aspects®. 


Problem 

Approach 

Size 

Source 

Spanning tree 

interval regret 

~ 100 nodes 

[PGAMCVT14] 

Knapsack 

finite strict 

~ 1500 items 

[Goel4a] 

Knapsack 

finite recoverable 

~ 500 items 

[BKKlla] 

Knapsack 

cc strict 

~ 5000 items 

[MPS13] 

Knapsack 

cc recoverable 

~ 200 items 

[BKKllb] 

Shortest path 

interval regret 

~ 1500 nodes 

[GG15] 

Assignment 

interval regret 

~ 500 items 

[PAll] 


Table 3; Currently considered problem sizes for exact algorithms. 

What becomes immediately obvious is that these limits are much smaller than for 
their nominal problem counterparts, which can go easily into the millions. 

5.5 Learning from Experiments 

We exemplarily show how experimental results can be used to design better algorithms 
for robust optimization; thus, we highlight the potential that lies in following the al¬ 
gorithm engineering cycle. To this end, we consider the regret shortest path problem; 
Given a set of scenarios consisting of arc lengths in a graph, find a path from a fixed 
source node to a fixed sink node which minimizes the worst-case length difference to an 
optimal path for each scenario. 

From a theoretical perspective, the problem complexity is well-understood. For dis¬ 
crete uncertainty sets (and already for only two scenarios), the problem was shown to 
be NP-hard in the seminal monograph [KY97]. For interval-based uncertainty, [Zie04] 
showed its NP-hardness. 

Furthermore, it is known that the regret shortest path problem with a finite, but 
unbounded set of scenarios is not approximable within 2 — e. For the interval-case, a 
very simple 2-approximation algorithm (see [KZ06]) is known: All one needs to do is to 
compute the shortest path with respect to the midpoint scenario, i.e., the arc lengths 
which are the midpoint of the respective intervals. 

To solve the interval regret problem exactly, a branch-and-bound method has been 
proposed [MG04], which branches along the worst-case path in the graph. However, 
computational experience shows that the midpoint solution - despite being “only” a 


®Number of items for finite, strict knapsack is estimated with the pegging test from [TYK08]. 
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2-approximation - is already an optimal, or close-to-optimal solution for many of the 
randomly generated benchmark instances. 

Examining this aspect in more detail, [CG15] developed an instance-dependent ap¬ 
proximation guarantee for the midpoint solution, which is always less or equal to 2, but 
usually lies around 1.6 — 1. T. 

Using these two ingredients - the strong observed performance of the midpoint so¬ 
lution, and its instance-dependent lower bound - the branch-and-bound algorithm of 
[MG04] can be easily adapted, by using a midpoint-path-based branching strategy in¬ 
stead of the worst-case path, and by using the improved guarantee as a lower bound. 
The resulting algorithm considerably outperforms the previous version, with computa¬ 
tion times two orders of magnitude better for some instance classes. 

These modifications were possible by studying experimental results, improving there¬ 
upon the theoretical analysis, and feeding this analysis back to an algorithm. It is an 
example for the successful traversal of an algorithm engineering cycle, and we believe 
that many more such algorithmic improvements can be achieved this way. 

6 Algorithm Engineering in Robust Optimization and 
Conclusion 

In this paper we propose to use the algorithm engineering methodology to better un¬ 
derstand the open problems and challenges in robust optimization. Doing so, we were 
able to point out links between algorithm engineering and robust optimization, and we 
presented an overview on the state-of-the-art from this perspective. 

In order to further stress the usefulness of the algorithm engineering methodology, we 
finally present three examples. Each of them is composed of a series of papers, which 
together follow the algorithm engineering cycle in robust optimization. 

Example 1: Development of new models based on shortcomings of previous ones. 
[Soy73] introduced the concept of strict robustness. This concept was illustrated in 
several examples (e.g. from linear programming, see [BTNOO] or for a cantilever arm as 
in [BTN98]) and analyzed for these examples in a mathematical way. The analysis in 
these papers showed that the problem complexity increases then introducing robustness 
(e.g., the robust counterpart of an uncertain linear program with ellipsoidal uncertainty 
is an explicit conic quadratic program). Moreover, the authors recognized that the 
concept is rather conservative introducing an approximate robust counterpart with a 
more moderate level of conservatism. These ideas were taken up [BS04] to start the 
next run through the algorithm engineering cycle by introducing their new concept of 
cardinality constrained robustness, which is less conservative and computationally better 
tractable, but may be applied only to easier uncertainty sets. Applying this concept to 
train timetabling and performing experiments with it was the starting point of [FM09] 
who relaxed the constraints further and developed the concept of light robustness which 
was then later generalized to arbitrary uncertainty sets by [Schl4]. 

Example 2: From one-stage to two-stage robustness. 
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Recognizing that the concept of strict robustness is too conservative, [BTGGN03] pro¬ 
posed the first two-stage robustness approach by introducing their concept of adjustable 
robustness. When applying this concept to several application of railway planning within 
the ARRIVAL project (see [ARR]), [LLMS09] noted that the actions allowed to adjust a 
timetable do not fit the practical needs. This motivated them to integrate recovery ac¬ 
tions in robust planning yielding the concept of recoverable robustness. Unfortunately, 
recovery robust solutions are hard to obtain. Research on developing practical algo¬ 
rithms is still ongoing, recent examples are a column-generation based approach for ro¬ 
bust knapsack problems and shortest path problems with uncertain demand [BAvdHll], 
an approach using Bender’s decomposition for railway rolling stock planning [GGG'*“12], 
and the idea of replacing the recovery algorithm by a metric [GSlla,GS14, Goel2]. 

Example 3: Robust passenger information systems. 

The following example shows the application of the algorithm engineering cycle on a 
specific application, namely constructing robust timetable information systems. Suppose 
that a passenger wants to travel from an origin to some destination by public transporta¬ 
tion. The passenger can use a timetable information system which will provide routes 
with small traveling time. However, since delays are a matter of fact in public trans¬ 
portation, a robust route would be more valuable than just having a shortest route. 
In [GSS'’'14] this problem was considered for strictly robust routes: The model was set 
up, analyzed (showing that it is NP-complete), and an algorithm for its solution was 
designed. The experimental evaluation on real-world data showed that strictly robust 
routes are useless in practice: their traveling time is much too long. Based on these ex¬ 
periments, light robust passenger information system was considered. The light robust 
model was designed and analyzed; algorithms based on the strictly robust procedures 
could be developed. The experiments showed that this model is much better applica¬ 
ble in practice. However, the model was still not satisfactory, since it was assumed 
that a passenger stays on his/her route whatever happens. This drawback motivated to 
start the algorithm engineering cycle again in [GHMH'*'13] where now recoverable robust 
timetables are investigated. 

Gonsidering the cycle of design, analysis, implementation, and experiments, we were 
also able to identify pointers for further research. We summarize our results by repro¬ 
ducing the most significant messages: 

1. Robust optimization is application-driven. From the beginning, robust optimiza¬ 
tion was intended as an optimization approach which generates solutions that 
perform well in a realistic environment. As such, it is highly appealing to practi¬ 
tioners, who would rather sacrifice some nominal solution quality if the solution 
stability can be increased. 

2. Robust optimization needs a unified classification scheme. While the strong connec¬ 
tion to applications is a beneficial driver of research, it also carries problems. One 
striking observation is a lack of unification in robust optimization. This begins with 
simple nomenclature: The names for strict robustness, or the uncertainty set con¬ 
sidered by Bertsimas and Sim are plenty. It extends to the frequent re-development 
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of algorithmic ideas (as iterative scenario generation), and the reinvention of ro¬ 
bustness concepts from scratch for specific applications. This lack of organization 
is in fact unscientific, and endangers the successful perpetuation of research. As re¬ 
lated problems, some journals don’t even offer “robust optimization” as a subject 
classification (even though publishing papers on robust optimization); solutions 
generated by some fashion that is somehow related to uncertainty call themselves 
“robust”; and students that are new to the field have a hard time to identify the 
state-of-the-art. 

3. Performance guarantees are not sufficiently researched in robust optimization. Also 
this point can be regarded as related to robust optimization being application- 
driven and non-unified. Performance guarantees are of special importance when 
comparing algorithms; hence, with a lack of comparison, there also comes a lack 
of performance guarantees. This includes the comparison of robust optimization 
concepts, of robust optimization algorithms, and even the general evaluation of a 
robust solution compared to a non-robust solution. 

4. There is no robust optimization library available with specifically designed algo¬ 
rithms other than reformulation approaches. While libraries for robust optimiza¬ 
tion exist, they concentrate on the modeling aspects of uncertainty, and less on 
different algorithmic approaches. Having such a library available would prove ex¬ 
tremely helpful not only for practitioners, but also for researches that develop new 
algorithms and try to compare them to the state-of-the-art. 

5. There are too few comparative studies in robust optimization. All the above points 
culminate in the lack of comparative studies; however, we argue that here also lies 
a chance to tackle these problems. This paper is a humble step to motivate such 
research, and we hope for many more publications to come. 
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